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Abstract 

A  technique  using  Hough  transform  is  described  for  detection  of  homogeneous 
line  segments  directly  from  (i.e.,  without  binarization  of)  gray  level  images.  A 
definition  of  “region”  in  terms  of  these  line  segments,  with  constraints  on  its 
length  and  variance,  is  provided.  The  algorithm  is  able  to  extract  gray  regions 
irrespective  of  their  shape  and  size.  The  effectiveness  of  the  method  is  demon¬ 
strated  on  Indian  Remote-sensing  Satellite(IRS)  images. 
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1  Introduction 


Hough  transforms  (HT)  are  used  for  finding  straight  lines  or  analytic  curves  in  a  binary 
■mage.  There  are  several  ways  in  which  HT  for  straight  lines  can  be  formulated  and 
mp  emented.  It, see  has  hated  some  of  these  forms  and  analyzed  them  alongwith  their 
comp lex, t.s  m  (1).  The  most  popular  one  is  (*»)  form,  which  is  given  by  Duda  and 
Hart  [.J.  This  parametric  form  specifies  a  straight  line  in  terms  of  the  angle  t  (with 

the  abscssa)  of  its  normal  and  its  algebraic  distance  ,  from  the  origin.  The  equation 
Ot  such  a  line  in  x-y  plane  is, 


*  lel/O  1/ 


r  y  oul  v 


where  0  is  restricted  to  the  interval  [0.,].  This  form  is  used  because  of  its  simplicity 
o  undei stand  and  ease  in  implementation. 

Hough  transforms  are  applied  usually  on  binary  images.  Hence,  one  needs  to  convert 

7  '  77;  maSe  ,0  a  bi"ary  °"C  (thr0ush  threshoMi"S'  edge  detection,  thinning 

etc.)  to  apply  HT.  Note  that,  in  the  process  of  binarization,  some  information  regarding 

me  segments  the  image  may  get  lost.  Thus,  it  becomes  appropriate  and  necessary 
to  find  a  way  of  making  HT  applicable  directly  on  gray  images. 

This  article  is  an  attempt  in  that  direction  where,  we  present  a  technique  for  extract- 
mg  homogeneous  regions  of  arbitrary  shape  and  size  in  a  gray  level  image  based  on 
Hough  transform.  The  regions  are  defined  in  term  of  homogeneous  line  segments.  The 
technique  includes  some  operations  which  are  performed  in  a  window  to  obtain  homo- 

“Se“  F7eVe,'V  “Uanti2ed  (M)  in  tlK  «“*>■  sPace  (f>  represents 
I  ,91  ’  II  P'eSen  S  ang  e  ’  the  Varlance  of  the  P‘xel  intensities  contributing  to  the 
M  cel  ,s  computed.  The  cells  whose  variances  are  less  than  a  pre-specified  thresh- 

oW,  are  found.  Each  such  cell  would  represent  a  homogeneous  line  segment  in  the 
image.  The  window  is  then  moved  over  the  entire  image,  so  as  to  result  in  an  output 
consisting  of  only  the  homogeneous  line  segments,  thereby  constituting  different  ho¬ 
mogeneous  regions.  The  performance  of  the  method  has  been  demonstrated  on  Indian 
Remote-sensing  Satellite IRS)  images  for  different  parameter  values. 

In  this  connection  we  mention  the  methods  of  gray  scale  Hough  transform  (GSHT) 
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of  Lo  and  Tsai  [3],  and  generalized  Hough  transform  (GHT)  of  Ballard  [4],  GSHT 
enables  one  to  find  thick  lines  (called  bands)  from  gray  scale  images.  Therefore,  it 
can  be  used  for  detecting  road  like  structures  only  in  remote-sensing  images.  GHT  is 
able  to  extract  arbitrary  shapes  from  the  edge  map  of  a  gray  image  using  prototype 
information  of  the  objects  to  be  extracted.  Note  that  our  method  does  not  need  this 
information  and  is  thus  able  to  extract  objects  of  irregular  shapes  and  arbitrary  sizes 
as  found  in  remote  sensing  images. 


2  Definition  and  Formulation 

A  region  in  a  gray  image  can  be  viewed  as  a  union  of  several  line  segments,  so  that 
it  consists  of  a  connected  set  of  pixels  having  low  gray  level  variation.  Therefore,  to 
extract  a  region,  we  need  to  define  a  line  segment  in  gray  level  image.  A  line  segment 
in  a  gray  level  image  is  defined  using  two  threshold  parameters,  minimum  length  of 
the  line  (/)  and  maximum  variation  of  the  line  (r).  The  mathematical  formulation  of 
the  region  in  terms  of  line  segments  is  stated  below. 

Def.  1:  A  pixel  P  =  (?,_/)  is  said  to  fall  on  a  line  segment  joining  the  pixels  P,  = 
and  P2  =  (iiyjt)  if  3  A0,  0  <  Ao  <  1  such  that 

^0  Pi  +  (1  -  A0)  P2  =  P. 

Def.  2.  A  collection  of  pixels  L(l,v)  is  said  to  be  a  line  segment  in  a  gray  image  if, 

there  exist  P,  =  and  P2  =  (i2,j3),  P,  ^  P2;  such  that 

=  {  P  :  P  is  a  pixel  falling  on  the  line  segment  joining  Px  and  P2  }, 

•  The  number  of  pixels  in  L(l,v)  is  >  /,  and 

•  The  variance  of  the  gray  values  of  pixels  in  L(l,v)  <  v. 

Let  Aitl,  =  {L(l,  v)  :  L(l,v)  is  a  line  segment  in  the  image}.  That  is  At,v  repre¬ 
sents  the  collection  of  all  line  segments  in  the  image. 

Def.  3.1:  A  pixel  P  is  said  to  be  in  the  homogeneous  region  if  P  £  L(l,v),  at  least 
for  one  L(l,v)  €  A,,v. 
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Def.  3.2:  A  pixel  P  is  said  to  be  in  the  non-homogeneous  region  if  P  g  L(l,v) 
VL(l,v)  €  Av- 

Let  Nh  —  {P  P  is  a  pixel  in  the  non-homogeneous  region  }. 

The  region  R  is  defined  as  follows. 


Def.  4.1:  Let  Lx{t,v)  and  L2(l,v)  €  A,,v.  Then  /,,(/,  v)  and  L2(l,v )  are  said  to 
be  directly  connected  if  either  X,(/,v)  n  L2{l,v)  ±  <j>  or  3  pixels  P,  g 
Lx{l,v)  and  P2  6  L2{l,v)  such  that  Px  is  one  of  the  eight  neighbours  of  P2. 
Note  that  a  line  segment  L(l,v)  is  directly  connected  to  itself. 


Def.  4.2:  Two  line  segments  La{l,v)  and  L0(l,v)  belonging  to  A,,v  are  said  to 
be  connected  if  they  are  directly  connected  or  there  exist  L,(l,v)  6  At  v  ; 

i  —  1,2,...,  A-  where  k  >  3  such  that  L,(/,  r)  and  Lj+X(l,v)  are  directly  connected 
Vi  =  1,2,  ...,(A-  —  1) 

where  Lx(l,v)  =  La(l,  r)  and  Lk{l,  v)  =  L0[l,v). 


Def.  4.3:  Let  BLa(l,v)  =  {L(l, v)  :  L(Lv)  €  A,,v. 
connected  }.  Ia(/,r)  €  At,v. 


and  L(l,v)  and  La(l,v)  are 


Note  that  for  La{l,  v),  Lq(1,  v)  G  Ai>v  either 

=  BLfi(l,v)  or  BLa(l,v)C\  BLg(l,v)  =  <j> 

Note  also  that  (J  BLo{l,v)  =  Al<v. 

La[l,v)£At  v 

That  is  AitV  is  partitioned  into  finitely  many  sets  using  BLo(l,  v)'s. 


Def.  4.4:  Let  RLa(l,v)  -  U nt,v)eBLa(i.v)L{l,v).  Then  Ria(l,v)  is  said  to  be  a  region 
generated  by  La(l,  v).  Note  that  Ria{l,v)  is  a  set  consisting  of  pixels  in  the 
given  image.  Observe  also  that  the  same  region  can  be  generated  by  different 
line  segments  (follows  from  Def.  4.3) 


2.1  Observations  on  the  above  definitions 

(a)  A  line  segment  may  be  termed  as  a  region  according  to  the  above  definitions. 
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(b)  The  variance  of  n  points  xux2, ... ,i„ ,  is  given  by  i  ^(x.-x)2  where  x  =  i  X{. 

Now,  variance  <  v  =►  £(x,  -  x )2  <  nv.  *  *”*’ 

Observe  that  there  may  be  a  point  (say,  x')  among  xu  x2, ...,  xn,  such  that  (x'-x)2 
may  be  high  (say,  (x'  -  x)2  >  kv,  where  k  >  1).  Even  then  £(x,  -  x)2  can 
still  be  less  than  nv.  This  observation  indicates  the  removal  of  noise  upto  some 
extent  by  the  proposed  variance  based  definition  of  line  segment. 

(c)  The  values  for  /  and  v  are  to  be  chosen  “appropriately”  to  obtain  the  actual  regions 

in  an  image.  Some  portions  of  the  actual  regions  may  not  be  obtained  if  the  value 
of  l  is  high.  If  the  value  of  t;  is  high  then  some  spurious  collection  of  pixels  may 
be  termed  as  a  region.  If  the  value  r  is  low  then  some  actual  regions  in  the  image 

may  not  be  obtained.  Similarly  if  the  value  of  /  is  low  then  some  unwanted 
regions  may  arise. 

(d)  Observe  that  a  pixel  P  does  not  fall  into  any  region  =>  There  exists  no  line 

segment  passing  through  P  with  low  gray  level  variation  (i.e.  variance  of  the 
gray  level  values  of  the  pixels  on  any  line  segment  passing  through  P  is  greater 
than  v).  Hence  the  above  stated  definitions  intend  to  suppress  the  pixels  in  the 
non-homogeneous  region  of  the  image. 

(e)  Note  that  two  adjacent  collections  of  connected  pixels,  each  collection  of  pixels 

having  some  gray  level  value  but  the  gray  level  value  for  one  collection  is  distinctly 
different  from  the  gray  level  value  of  the  other,  may  fall  into  the  same  region 
(thus  losing  their  identity)  according  to  the  definitions.  A  further  processing  of 
this  region  will  provide  the  above  stated  two  collections  distinctly.  (One  of  the 
simplest  ways  of  obtaining  the  two  collection  of  pixels  is  to  apply  the  gray  level 
thresholding  methodology  on  the  region  thus  obtained.)  4 

The  definitions  regarding  regions  have  been  stated  above.  There  may  exist  several 
other  ways  of  obtaining  the  said  regions  from  the  image.  Note  that  regions  have  been 
defined  as  a  union  of  line  segments,  and  Hough  transform  is  a  standard  method  of 
obtaining  line  segments.  But  the  Hough  transform  finds  line  segments  in  a  binary 
image.  In  order  to  make  HT  applicable  directly  on  a  gray  image,  we  formulate  a 

method  in  the  next  section  which  is  able  to  find  line  segments  (and  hence  the  regions) 
in  a  gray  image. 
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2.2  Strategies  of  region  extraction  in  gray  level  image  using 
Hough  transform 

Extraction  of  line  segments: 

(i)  Consider  the  equation  for  a  straight  line  to  be  x  cos  0  +  y  sin  0  =  p.  Apply 

suitable  sampling  on  0  and  />,  and  construct  the  Hough  accumulator.  Transform 
each  point  of  the  image  (pixel)  using  different  values  of  0  (and  jts  corresponding 
p  values).  Note  that  a  point  in  the  image  space  is  mapped  to  more  than  one  cell 
in  the  Hough  space  and  each  of  these  cells  represents  a  line  in  the  image  space. 

(ii)  Compute,  for  each  cell,  the  length  of  the  corresponding  line  (L)  as  the  total  number 

of  imago  points  (pixels)  mapped  into  that  cell,  i.e.,  the  cell  count.  Variance  of 
the  said  pixel  values  may  be  termed  as  the  variance  {V)  of  the  corresponding 
line. 

(iii)  For  a  cell  in  the  Hough  space  if  the  length  of  the  line  is  less  than  /  or  variance  of 
the  line  is  greater  than  v  then  suppress  the  cell  in  the  Hough  space. 

(iv)  Remap  this  Hough  space  (containing  unsuppressed  cells)  to  image  space.  This 
process  of  remapping  preserves  all  those  pixels  which  are  not  suppressed  in  at 
least  one  of  the  cells  of  the  Hough  space.  Since  this  transformation  preserves 
only  the  location  of  pixels,  not  their  gray  values,  they  may  be  restored  from  the 
original  image. 

Let  us  consider  an  image  of  size  M  x  AI.  If  M  is  too  large  compared  to  the  threshold 
parameter  /,  then  L  values  (cell  counts)  will  be  larger,  and  as  a  result,  variance  of  the 
gray  levels  on  a  line  may  exceed  the  threshold  value  r.  Many  genuine  line  segments, 
therefore,  may  not  be  detected  in  such  a  case.  To  avoid  this,  the  search  process  for 
obtaining  the  line  segments  is  to  be  conducted  locally.  That  is,  a  window  of  size  u  xu 
needs  to  be  moved  over  the  entire  image  to  search  for  line  segments.  Here  u>  may  be 
taken  as,  2/  >  u?  >  /,  because  u;  >  21  may  still  lead  to  the  suppression  of  actual  lines 
in  the  image. 
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Extraction  of  Regions: 

\ 

One  can  clearly  see  that  the  above  mentioned  process  extracts  line  segments  which  are 
connected  according  to  the  Definition  4.  Therefore  the  collection  of  these  line  segments 
will  result  in  regions  of  different  sizes  and  shapes. 

Note: 

•  There  is  no  restriction  on  the  shape  of  the  “region’’  thus  obtained.  The  only 
restriction,  we  used  on  the  size  of  the  region  (i.e.,  length  of  the  line  >  /),  is  a 
weak  one. 

•  The  method  does  not  need  any  prior  representation  of  the  shape  of  region  to  be 
detected.  Therefore,  it  can  extract  regions  of  arbitrary  shape  and  size. 

3  Algorithm  and  Implementation 

It  has  been  mentioned  in  the  earlier  section  that  values  for  /  (length  of  the  line),  v 
(vaiiance  threshold)  and  us  (window  size)  are  to  be  selected  and  the  obtained  lines  are 
to  be  remapped  to  image  domain  to  procure  regions.  This  process  of  remapping  the 
cells  in  the  Hough  space  is  to  be  carried  out  on  every  window.  The  steps  of  the  entire 
algorithm  are  stated  below. 

Step  1.  Foi  a  window  (u  x  u;)  of  the  image  obtain  the  Hough  accumulator  values  for 
different  p  and  6.  p  values  and  9  values  are  sampled  suitably'  in  their  respective 
domains.  For  each  cell  in  Hough  space,  mean  and  variance  of  corresponding 
pixel  values  in  the  image  domain  are  computed  using  two  more  accumulators 
(one  for  sum  of  gray  values  x  and  one  for  sum  of  squares  of  gray  values  x 2)- 
These  sum  and  sum  of  squares  along  with  the  count  of  cells  (L)  will  be  used  for 

computing  the  variance  V  =  - ^  of  the  ceil.  If  the  cell  count  is  <  / 

then  replace  the  cell  count  by  zero  (i.e.,  the  cell  is  suppressed).  If  V  >  v  then 
also  replace  the  cell  count  by  zero.  The  cells  with  count  non-zero  are  remapped 
to  image  domain  preserving  the  position  of  window. 
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Step  2:  Repeat  Step  1  for  all  possible  windows  of  size  u  x  u  in  the  image. 

Step  3:  Restore  the  gray  values  of  remapped  pixels  from  the  original  image. 

The  number  of  computations  in  the  aforesaid  algorithm  can  be  reduced  drastically  in 

the  following  way. 

(i)  Note  that  for  a  given  window  size  w,  Hough  transformation  of  the  pixel  does  not 
change  with  its  location,  because  the  reference  frame  for  computing  0  (and  hence 
p)  remains  the  same.  Thus,  the  Hough  accumulator  values  can  be  calculated 
only  once  and  be  used  for  every  position  of  the  window. 

(li)  Again,  all  possible  windows  of  size  w  x  w  need  not  be  considered.  The  window  can 
be  moved  by  half  of  its  size,  both  horizontally  and  vertically.  This  process,  though 

maiginally  reduces  the  accuracy  of  the  regions  obtained,  decreases  computations 
drastically. 

(iii)  Keeping  the  point  (iv)  of  section  2.2  in  mind,  the  process  of  restoring  gray  values 
in  the  aforesaid  Step  3  can  be  combined  with  Step  1  by  preserving  only  those 
pixels  in  the  image  domain  which  are  not  getting  suppressed  in  at  least  one  cell 
of  the  Hough  space. 

4  Results 


We  have  applied  the  proposed  method  on  IRS  (Indian  Remote-sensing  Satellite)  images 
to  demonstrate  its  usefulness.  The  IRS  images  considered  here  have  spatial  resolution 
of  36.25m  x  36.25m,  wavelength  range  0.77 /im  -  0.86/im  and  gray  level  values  in  the 
range  0-127  [5].  Size  of  the  images  is  512  x  512.  An  enhanced  (linearly  stretched) 
image  is  provided  in  Fig.  l.a  (city  of  Calcutta)  and  Fig  2.a  (city  of  Bombay)  for  the 
convenience  of  readers,  since  the  original  images  are  poorly  illuminated.  However  the 
method  has  been  implemented  on  the  original  images. 

In  the  present  investigation,  we  have  used  w  =  16  and  /  =  14  for  various  values  of  v. 
The  output  corresponding  to  Fig  l.a  and  2.a  for  v  =  0.2,  0.4  and  0.6  are  shown  is  Figs. 
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l.b,  l.c  and  l.d,  and  Figs.  2.b,  2.c  and  2.d  respectively.  As  u  increases,  the  number 
and  size  of  detected  regions,  as  expected,  increase.  Note  that  the  set  of  pixels  in  Fig. 
l.b  is  a  subset  of  that  of  Fig.  l.c,  similarly  Fig.  l.c  is  a  subset  of  Fig.  l.d. 

One  can  see  that  some  of  the  vegetation  and  habitation  areas  along  with  some  roads 
of  Calcutta,  which  are  visible  in  Fig.  l.d,  were  not  detected  for  r  =  0.2  (Fig.  l.b)  and 
0.4  (Fig.  l.c).  This  is  also  true  for  the  Bombay  image.  The  river  Ganges  in  Calcutta 
image  has  come  out  in  all  the  cases  as  a  single  region,  except  for  r  =  0.2  where  the 
two  bridges  on  the  river  were  detected  as  different  regions.  On  the  other  hand,  the 
bridge  on  the  creek  water  in  Bombay  image  is  found  to  be  visible  for  all  the  values  of 
although  the  detected  sea  for  v  =  0.2  is  not  as  smooth  as  in  the  cases  of  v  =  0.4 
and  0.6.  Experiment  was  also  conducted  for  other  values  of  /  such  as  /  =  15  and  16, 
but  the  results  were  not  much  different. 


5  Conclusions  and  Discussion 

A  method  of  extracting  regions  in  a  gray  level  image  using  the  principle  of  Hough 
Transform  has  been  described.  A  definition  of  ‘•region"  in  terms  of  line  segments  is 
provided.  Since  the  methodology  docs  not  involve  any  representation  (such  as  para¬ 
metric,  template  etc.)  of  the  shape  of  regions,  it  has  the  ability  to  detect  regions  of 
arbitrary  shape  and  size. 

To  restrict  the  size  of  the  article,  we  have  presented  the  results  corresponding  to  e 

0.6  foi  u.  —  16  and  /  =  14  only,  although  the  experiment  was  also 
conducted  for  other  values  of  /  (e.g.,  15  and  16)  and  «  (e.g.,  S,  24  and  32).  Variance 
of  pixel  values  is  used  here  as  a  measure  of  homogeneity  of  line  segment.  One  may  use 
any  other  homogeneity  measure  for  this  purpose. 

Note  that  selection  of  r  is  crucial.  For  an  image  with  greater  variance,  one  needs  a 
high  value  of  v  for  meaningful  interpretation  of  the  detected  regions. 
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Fig.  l.c:  Output  with  r  =  0.4 


Fig.  l.d:  Output  with  r  =  0.6 


Fig.  2.c:  Output  with  r  =  0.4 


Fig.  2. cl:  Output  with  r  =  0.6 


